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ABSTRACT 


The technique most widely used for detailed image evaluation of 
aerial and space photography has been edge analysis; Edges have been 
used because they appear more frequently in aerial scenes than do other 
simple objects such as points or lines. Methods for measurement and 
analysis of edges have been investigated extensively. 

One fundamental limitation of analysis employing naturally occurring 
edges is that the object must be assumed perfect; i.e., the edge appearing 
in the scene is assumed to be exactly a step function, uniform on both sides 
and with a perfect discontinuity at the edge. This is certainly not true 
of natural edges such as coast lines, field boundaries, etc., and it is not 
generally true of randomly occurring man-made edges, for example building 
roofs, pavement boundaries, etc. Even if there is a perfect edge object 
in the scene, its position and orientation are unique, and hence the 
analysis is limited. In addition, for sensors with low ground resolution, 
such as those on the Earth Resources Technology Satellite (ERTS) , the 
size requirements on man-made edges are prohibitive. 

For these reasons we have investigated a technique that is largely 
independent of object scene. The approach is particularly applicable to 
evaluation of earth-orbiting multispectral sensors. In all programs 
employing such sensors, simultaneous underflight photography from aircraft 
is made during passes of the spacecraft. 

To evaluate the spacecraft imagery, the two sets of photographs are 
scanned and digitized with a microdensitometer, the same ground area being 
scanned in each case. The data are then Fourier analyzed, and the spatial 
frequency spectra is calculated. The spatial frequencies in the underflight 



trace are scaled to those in the spacecraft trace (by the ratio of al- 
titudes if the two systems are of equal focal length) , and the ratio 
of the spectra gives the in-flight OTF,r(f), for the orbiting sensor, 

T (f ) = I (f )/0 (f) 

In detail we must calibrate the spectroradiometric and distortion 
characteristics of the underflight sensor in the region of the image 
field that was scanned with the microdensitometer. Furthermore, the 
transfer function of this system must be known for the same region. 

However, because of the scale change for comparison of the images, we 
are interested only in very low spatial frequencies in the underflight 
image, thus relaxing the requirement on exact knowledge of the under- 
flight sensor OTF. 

The method has been applied to an Apollo 9 (S065 experiment) frame, 
and the sensor OTF has been calculated. Image quality was also compared, 
using the same method, in second and fourth generation copies of the 
original film. The results are good enough to encourage use of the 
technique and to indicate the accuracies required of the various measurements 
involved in determining in-flight sensor OTF by this method. 

Results of investigations in progress will be presented. A technique 
for determining correct scan registration and scaling between the two sets 
of imagery will be dissussed and a promising approach to noise reduction, 
in the form of weighted averaging of OTF's from several scans, will be 


described. 
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I. INTRODUCTION 

The ‘past few years have seen an increasing interest in the worldwide 
assessment of natural resources and the detection of environmental pollution. 
A common characteristic of many instruments used for such purposes is 
that they monitor radiation reflected from, or emitted by large areas 
of the earth’s surface, in different parts of the electromagnetic spectrum. 
Frequently, the output from these instruments, which are referred to as 
multispectral remote sensors, is converted into a photographic image 
for analysis purposes. For example, the density function of the image 
may be digitized with a microdensitometer . The resulting values are 
related to ground reflectances (not a straightforward task) , which are 
used as an aid in the production of thematic' maps from the imagery. ^ 

One subject of practical interest to those analyzing imagery from 
orbiting spacecraft is the quality of the imagery, which is expressed 
in terms of spatial resolution and spectroradiometric accuracy, quantities 
that are related and equally important in remote sensor imagery. The 
blurring of the object, which occurs in any image, decreases the accuracy 
of spectroradiometric calculations on microimage areas, particularly 
when the image modulation is decreased to the point where it becomes 
indistinguishable from noise. 

We are concerned here with techniques for measuring the quality 
of operational imagery and in particular with a method that is uniquely 
suited to the characteristics of orbiting multispectral sensors. In 
the next section several of these characteristics will be discussed from 
the viewpoint of their importance to the image evaluation problem. 



2 


Factors Influencing the Selection of an Image Evaluation Method 

In selecting an inflight image evaluation method we first have 
to take into account the unique characteristics of both orbital 
multispectral sensors and the imagery they produce, Multispectral 
sensors form several images of the ground scene simultaneously through 
broad band spectral filters or dispersive elements. Now in general 
the spatial distribution of scene radiance will be different from 
band to band. Thus, the edge between two fields may be a good step 
function in a red band, but owing to sparse vegetation near the edge, 
it may be a poor step function in a green band. Consequently a given 
object, particularly a naturally occurring one, may not be suitable 
for evaluating the image in all bands of the sensor. In addition, 
wavelength-dependent scattering of light in the atmosphere will reduce 
the modulation of the image by different amounts in each band. The 
signal-to-noise ratio will therefore vary from band to band even if 
the image recording components in each band are identical. Moreover, 
the optical system(s) used in the sensor will generally have different 
imaging characteristics in each band because of the dependence of 
aberrations on wavelength. 

The low ground resolution typical of these sensors bears directly 

on the choice of an image evaluation method. Table 1 below 

» 

compares the resolution of low-contrast, three-bar ground targets for 

2,3 


past, current, and future systems: 
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Table 1 

Resolution of Earth-Orbiting Remote Sensors 


Sensor 

Approximate 
m/line pair 

Ground Resolution 
line pair /km 

Apollo 9 S065 experiment 
(4 Hasselblad cameras) 

100 

10 

ERTS-1 (Earth Resources Technology 
RBV (Return Beam Vidicon) 

MSS (Multispectral Scanner) 

Satellite) 

180-280 

300 

3. 5-5. 5 
3.5 

Skylab S190 experiment 
(6-lens Itek camera) 

20-100 

10-50 


As we will discuss further in the next section, these values 

generally rule out the possibility of utilizing man-made test targets. 

Finally, in all earth remote sensing programs involving spaceborne 

sensors, for example, those onboard NASA’s Earth Resources Technology 

Satellite, simultaneous underflight photography is scheduled regularly. 

The imagery from these underflights is used as an aid for calibration 

of spacecraft data in terms of ground measurements. The aircraft 

sensors usually use the same spectral bands as those in the spacecraft 

4 

and in some cases duplicate systems are under construction. Simultaneous 
under flights are flown from low altitudes of a few hundred meters to 
very high altitudes of 15 to 20 km. The imagery from these underflights 
is necessary for the image evaluation technique discussed in this paper. 
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Review of Current In-Flight Image Evaluation Techniques 

Sensor imaging capabilities can be predicted at the design 
stage and measured in the laboratory for complete systems. 

However, sensor performance cannot be predicted accurately and reliably 
for an extended operational period in the space environment. Imaging 
systems carried by aircraft are often evaluated in-flight by the use 
of the three-bar resolution type of ground target. In this 
discussion we are concerned, however, with a more complete analysis 
that extends to the measurement of the optical transfer function 
(OTF) , which is symbolized by T(f) where f is a (possibly) two-dimensional 
spatial frequency variable. 

Measurement of x(f) for in-flight sensors has been achieved with 

the use of special objects such as man-made edges ^ or lines ^ and 

their naturally occurring counterparts in the form of coast lines, 

7 

field boundaries, lunar crater edges, etc. The use of naturally 
occurring targets has several limitations. Ideal edges and lines do 
not occur in nature and reasonable facsimiles are often of unknown quality. 
As mentioned earlier, a given target may not be suitable for the 
evaluation of all the bands in a multispectral sensor. Furthermore, 
the low ground resolution typical of many of these sensors sets a 
severe requirement on the minimum size of both natural and man-made 
targets. Consider a sensor with a lOOm/cycle ground resolution and let 
that distance correspond roughly to the half width of the central 
lobe in the sensor spread function. Then, if we want to measure the 
first or second side lobes of the spread function, the length of 
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the target in any given direction must be at least 200 to 300 m 

and at least that long in the perpendicular direction. Naturally 

occurring objects that are large and straight over that length 

would be difficult to find, and deployment and maintenance of such large 

man-made targets would be difficult if not impossible. Even if such an 

object was used, its position and orientation in the field of view would 

be unique, and consequently its use would be limited. 

The technique we will describe can be applied to any imagery 
for which there is simultaneous underflight coverage, and it does not have 
any direct dependence on the nature of the object. Consequently, it 
is of more practical value than an analysis using isolated targets. 
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II. THEORY 

The fundamental imaging equation for linear, stationary 
optical systems is 

id) - xd)Q(f> 

where 1(f) and 0(f) are the image and object spatial spectra, respectively. 
In general, all quantities in this equation are complex. 

To measure x(f) it is necessary to know 1(f) and 0(f). As 
discussed above, Off) is not known for naturally occurring objects. 

Man-made targets are often used because 0(f) is then known and 1(f) can be 
measured from the imagery. Now the simultaneous under flight imagery 
obtained in multispectral sensor experiments gives us a good measure 
of 0(f) for any part of a scene. The scale factor between the underflight 
imagery and the spacecraft imagery indicates that we need measure only 
very low spatial frequencies in the underflight image arid then scale 
these up to the correspondingly higher frequencies in the spacecraft 
image to evaluate x(f). For example, if the cutoff frequency 
(assuming noiseless imagery) of the spacecraft sensor OTF is 50 cycles/mm 
and the aircraft underflight sensor is of the same focal length and 
flown at an altitude l/10th of that of the spacecraft, frequencies 
up to only 5 cycles /mm need to be measured in the underflight image. 

To determine 0(f), the OTF for the aircraft sensor should be divided 
into the underflight image spectrum, but the highest frequency of 
interest, which in the above case is 5 cycles /mm, may be so low that 
this correction is unnecessary. 
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In practice, the two sets of images from the spacecraft and the 
simultaneous underflight can be scanned and digitized with a microdensitometer 
in either one or two dimensions* The same ground area is scanned in 
each set of images, and the scanning aperture size and sampling rate 
are scaled by approximately the scale between the images. Because of 
the scale factor, the aperture size is large for the underflight image. 

In the previous example, the aperture size would be about 100 to 200 
ym. Photographic grain noise is thus a minor . problem in the measurement 
of 0(f). For one-dimensional scans a slit aperture can be used to 
reduce the grain noise even further. 

Now, the spacecraft image scan should not be longer than 
the size of an isoplanatic, or stationary, region to ensure that 
x(f) is essentially constant over the scan length. Because the same 
ground area is scanned in each of the two images, the length of the underflight 
image scan is longer than the spacecraft image scan. Thus, the underflight 

image scan may extend over a significant part of the field (say 5 to 10 ) 
and care should be taken that this scan also does not extend outside an 
isoplanatic region. However, the restriction to low frequencies in 
this image means that , the underflight sensor OTF , in this frequency 
range, will likely be constant over the scan length. 

In addition to the sensitometric conversion from film density 
to effective image irradiance for all data, the underflight image 

4 

data should be corrected for cos falloff in irradiance off axis. 

Distortion in the underflight image owing to topographic 
elevation differences on the ground should be considered. The 
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positional distortion Ar for an image point at a distance v from the 
center of the image is given by 


Ar 


r 


A H 
H 


where Aff is the difference in ground elevation of the on-axis object 

point and the point imaged at r, and H is the aircraft altitude. For 

H = 20 km, A# = 100 m, and r = 10 mm, we have Ar = 0.05 mm, 

which is less than the required microdensitometer aperture size mentioned earlier 

and would be considered negligible. For bach scan, however, it would be prudent 

to check topographic maps of the area, estimate the distortion from 

elevation differences, and, if necessary, apply a correctional transformation 

to the data. 

Because it is unlikely that the aperture size and sample interval 
could be scaled exactly on the microdensitometer, correction for aperture 
and microdensitometer OTF and exact scaling of the data must be done on 
the digitized data in a computer. A technique for scaling that has 
been successful is to start at the same ground point in both the 
spacecraft and underflight image, take the same number of points in 
each set of data but with the sample interval on the underflight image 
chosen as close as possible to the scale factor times the sample interval 
on the spacecraft image, and stretch or shrink the under flight image 
in consecutive steps by a linear interpolation scheme, which keeps 
the number of points constant. The integrals 


mean squared difference 


J [a 00 - .i 00] 2 dx 


\ 


[o 60] 2 dx 
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correlation factor = Jo(x) £(x) dx 

[c(x)] 2 dx 

are evaluated for each step of the stretching or shrinking process. 

A minimum will appear in the mean squared difference between object 
and image at some scale factor and a maximum will appear in the 
correlation factor, usually at the same scale factor. We thus have 
two independent criteria for detarmining the scale factor. In addition, 
by using this procedure, the same number of real points is obtained in 
each set of data, which allows us to use a fast Fourier transform 
(FFT) routine that performs two real transforms simultaneously, an 
efficient use of the FFT algorithm. 

After correction for microdensitometer OTF, sensitometry , and 
scaling, the data are Fourier transformed, and the ratio of corresponding 
spectral values gives the OTF of the spacecraft sensor. Now, in any 
procedure that involves sampled data and calculation of spectra, the 
spectra are replicated in the frequency domain at intervals of 1/Ax, 
the sample interval. If Ax is too large, overlap of the spectra may 

g 

occur, which, results in aliasing, i.e., high frequencies appearing as 
lower frequencies. We would expect aliasing to be most severe in the 
underflight image data where large values of Ax are used. However, the 
microdensitometer aperture is also large and consequently serves to reduce the 
modulation of higher frequencies and thus also the aliasing. Using 
underflight data from the Apollo9S065 experiment we have determined 
the aliasing errors, in Table 2 for one particular image spectrum. 
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The same set of data was used but was sampled at different intervals. 
The error was measured only for frequencies below the first zero, f c , 
of the scanning aperture OTF. 

Table 2 

Aliasing Error 


f Ax (mm) 1/Ax (cycles /mm) Maximum aliasing error 

^ - 'K/r t "\ i _ 



— 


Modulus 

Phase 

5 cycles /mm 

0. 012 

83 

assumed zero 

assumed zero 


0.024 

42 

5% 

10% 


0.048 

21 

5% 

50% 


0.096 

11 

5% 

50% 


In this example, the phase errors occurred only in the region of 2.5 to 
5 cycles /mm. 

Finally, we note that the low ground resolution and the large 
final product format sizes (S065 - 70-mm, ERTS - 24-cm) typical 
of orbital multispectral images means that the requirements placed on 
microdensitometry by the above technique are not severe. For example, 
in evaluating the S065 system, aperture sizes of 0.02 by 0.1 mm and 
0.2 by 1.0 mm and sample intervals of 0.006 mm and 0.06 mm were used 
on the spacecraft and underflight imagery, respectively. 
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III. EXAMPLES OF DATA FROM APOLLO 9 S065 EVALUATION 
Figure 1 shows microdensitometer scans of the image of the same 
ground area in each of three bands: BB [green filter, Pan-X film), CC 
(near-ir filter, black and white ir film), and DD (red filter, Pan-X film). 

The curves illustrate some of the statements made earlier. For example, the 
modulation in the BB band is the lowest of the three, which is due to atmospheric 
scattering and to low modulation of the object in the green (the image was of 

southern Arizona). Also note that grain noise in the ir band is more 
prominent than in the other two bands owing to the high granularity 
of the ir film. Figure 2 is a plot of the mean squared difference and 
correlation factor between the underflight (object, o ) and spacecraft (image , i ) 
scans (DD band) as a function of scale factor. It can be seen that a scale 
factor of about 10.7 gives the best match between object and image. The 
curves indicates that the two criteria for matching are sensitive to the 
scale factor, and it is expected that an accuracy of ±2.5% can be obtained 
in determination of the scale factor. Figure 3 shows the image function 
(DD band) and the object function as originally sampled and at the correct 
scale factor. , The same number of points is represented in each curve. 

Figure 4 illustrates the effect of aliasing. The modulus and phase of the 
spectrum of a set of underflight data, sampled at two different intervals, 
are shown . At the greater sample interval, the modulus has a positive error 
increasing at higher frequencies, and the phase shows random error also 
increasing at higher frequencies. Figure 5 is the OTF for the DD band, 
which was averaged over the OTF's obtained from several portions of 
one scan. The real and imaginary spectral components of the OTF determined 
from each set of data were weighted by the strength of the object spectral 


6 
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components and then averaged to obtain the final OTF. Only seven sets 
of data were used, and it appears that more are necessary to obtain a 
smoother OTF. 

Additional smoothing of the OTF was achieved by eliminating negative 
lobes in the corresponding spread function and by convolving the OTF with 
a gaussian function. 
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IV. DISCUSSION OF THE TECHNIQUE 

One of the difficulties in using natural terrain for image 

evaluation as discussed in this paper is the low modulation of the 

ground as seen from above the atmosphere. The recorded images are of 

even lower modulation and the signal-to-noise ratio, i.e. (image 
2 

modulation) / grain noise variance, which is a function of spatial 
frequency, can easily be as low as 5:1 and decrease rapidly with 
increasing spatial frequency. With edge analysis, multiple scans are 
usually averaged to increase the signal-to-noise, but this is not 
possible with the general technique described here. However, it is 
possible to decrease the uncertainty in the OTF by averaging OTF's 
obtained from several scans within an isoplanatic region. 

Locating exactly the same ground area and determining the scale 
between the two images are problems with this approach, but they can be 
handled satisfactorily by mean square difference and correlation matching. 

In spite of these difficulties, our approach possesses several 
unique assets. The orbiting sensor OTF can be determined from any 
imagery (and in any portion of the field of view) that is covered by 
simultaneous underflights. There is no need for special targets or 
reliance on natural objects of unknown quality as test objects. Indeed, 
the use of natural terrain for image evaluation provides additional 
information about the usefulness of the imagery. Those analyzing 
remote sensing data can use the statistical results of visual or 
machine-aided photointerpretation to establish relationships among the 
quantity and quality of data extractable from the imagery, the spatial 
frequency content of the imagery, and the sensor OTF. These relationships 
would not only be useful for determining the value of given imagery, but 

9 

also for specifying requirements on future sensors. 
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The technique has been applied to evaluation of the Apollo 9 
10 

S065 photography and is currently being used at the Optical Sciences 
Center for quality evaluation of the ERTS-1 RBV and MSS sensors. 

We wish to acknowledge NASA's continuing support of this effort 
under contract NAS 9-9333 for the Apollo 9 studies and contract 
NAS 5-21849 for the ERTS-1 investigation. 
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